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The spectral densities of ensembles of non-Hermitian sparse random matrices are analysed using 
the cavity method. We present a set of equations from which the spectral density of a given 
ensemble can be efficiently and exactly calculated. Within this approach, the generalised Girko's 
law is recovered easily. We compare our results with direct diagonalisation for a number of random 
matrix ensembles, finding excellent agreement. 



For decades, random matrix theory has been the focus 
of much attention in both physical and mathematical re- 
search, with an ever-expanding and remarkably diverse 
list of applications (for example, see jl[ for an extensive 
review of applications in physics). A problem of partic- 
ular interest is that of determining the spectral density 
of an ensemble of random matrices. In the early 1950's 
it was conjuectured that the eigenvalues of certain non- 
Hermitian random matrix ensembles should be spread 
evenly throughout the unit disk. Now known as Girko's 
law, this conjecture has been the subject of many rigorous 
and non-rigorous studies (e.g. @, 0, fl H and references 
therein), for various classes of random matrix ensemble. 

It is a natural desire, then, to extend our understand- 
ing of those ensembles that break away from this law. In 
the more accessible case of real symmetric matrices, it 
is known that the introduction of sparsity (that is, many 
entries of the matrix being zero) results in behaviour radi- 
cally different from that seen in the fully connected limit 
d, 0, H, H. Sparse real symmetric matrices have been 
studied extensively, and there exists various approxima- 
tive schemes |3, |g, |9], together with recent exact work 
[ToL ITU . [l2l ] . As we will see, sparsity also has a significant 
effect on the spectral density of general non-Hermitian 
matrices, however, this area has not received the atten- 
tion it deserves, and consequently a great deal remains 
unknown. 

In this letter, we tackle the problem of computing the 
spectral density of sparse non-Hermitian matrices using 
the cavity method [3, 0, EH- A simple closed set of 
equations is uncovered, whose solution characterises the 
spectral density of a given matrix. These equations are 
solved analytically in the fully connected limit, recover- 
ing the generalised Girko's law of We also present the 
results of a belief-propagation algorithm to quickly com- 
pute the solution for ensembles of large sparse matrices. 

Preparation. - Consider an ensemble M of N x N com- 
plex, non-Hermitian sparse random matrices. For a given 
matrix 4eM,we denote the collection of eigenvalues of 



Aby{\i 



1, iV}, if A is non-Hermitian, it follows 



that these are complex. For a point z = x + iy in the 
complex plane, we write the spectral density of A at z as 



results from av erag ing qa{z,z) over M.. Following, for 
example, @, [TH, Il6| | we are able to write 1 



-^lim^logdetif, (2) 



Qa{z, z) 

where we have introduced the 2N x 2N matrix 

kIjv i{z~1n — A) 



H = H(z, z; k) = 



i(zl N - Ay 



Kt 



N 



(3) 



We use (• • • ) for the complex-conjugate and (• • • ) for 
the conjugate-transpose. The next step is to write the 
determinant of H in terms of a Gaussian integral. In 
[a], the replica method was applied to the case of fully 
connected non-Hermitian Gaussian ensembles, deriving 
the generalised Girko's law in the limit N — ► 00. How- 
ever, little progress has been made in the study of sparse 
non-Hermitian matrices. To push forward, we tackle the 
problem by focusing on the behaviour of a large single 
instance. With a modest amount of foresight, we define 
N pairs of complex variables, 



ipi = 



Ui 



i = l,...,N 



(4) 



and introduce the 'Hamiltonian' 

JV 

H(il>,z,z; k) =y^| [k1 2 + i(xa x - ya y )] ipi 



(5) 



N 

-< E 4{A%a x -At a y )^ 

where o~ x and a v are the usual Pauli matrices, and we 
have written A = A h + iA s , with A h and A 8 Hermi- 
tian matrices. Continuing with the statistical mechanics 
metaphor, we also introduce a 'distribution' P and an 
'average' (■ ■ • ): 

1 



p(V) 



(•■■)= / p^W (•••), 



(6) 
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N 



g A (z,z) = -yj(x- Re\?)5(y ~ ImXf). (I) 



N ^ 

=1 



The spectral density of the ensemble, denoted as p(z, z), 



1 We use the notation conventions 
2 \dx dyj 



2 \dx dy , 
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where Z = (1). Of course, the measure we define here is 
complex and is manifestly not a real stochastic measure. 
However, much of the mathematics is unchanged, and it 
is relatively safe to use this probabilistic analogy. With 
this groundwork in place, equation ([2]) may finally be 
written as follows: 



Qa(z,z) 



1 



N 



1^ idz(ip f e o- + ip e ), 
i=i 



(J) 



where a + = a x + io~ y . In this formulation, it becomes 
clear that the local marginals Pi(ipi) will suffice to eval- 
uate qa- We calculate these marginals using the cavity 
method. 

Treelike Matrices.- We consider treelike sparse matri- 
ces. Associated with the matrix A there is a weighted, di- 
rected graph Qa on N vertices: a directed edge of weight 
Aij is drawn from vertex i to vertex j whenever Aij =/= 0. 
We say the graph Qa (and consequently the matrix A) 
is treelike if short loops are rare. There is a simple link 
between this graph and the Hamiltonian ©: the inter- 
action of variables ipi and ipj is encoded in the edges 
between i and j. We make the following standard defini- 
tions: a pair of vertices i, j are neighbours if either A^ or 
Aji is non-zero; the set of all neighbours of i is denoted 
di; ki denotes the number of neighbours of i (the degree 
of i); the average degree is given by c = TV -1 fcj. 

Notice that, if A is treelike, the variables neighboring 
ipi are correlated mainly through ipi. Consider a fictitious 
situation in which we have removed the variable ipi. We 
are interested in the change to the marginal distributions 
of the neighboring variables ip£ with £ £ di, which we 
denote by P^ l \ipg); with their common neighbour now 
absent, the joint distribution factorises: 



(8) 



let 



This is known as the Bethe approximation. It is exact 
on trees and graphs which remain treelike in the limit 
TV — > oo 2 . The cavity marginals {P^} obey simple 
recursive relations, 



-Hi 



r(J) 



£edi\j 



where Zf^ is a normalising constant, and we have split 
the Hamiltonian |(SJ| into the contributions from single 
variables, TLi, and from pairs of variables, Tiij, viz. 

Hi = ip\ [/sl 2 + i(xa x - yo-y)] ipi 

Ha = -iip\ {A%g x - Afjvy) ipi - iip] (A%o x - A] a,) ^. 

(10) 



(9) 



If the cavity distributions are known, the real marginal 
distribution at the vertex i can be recovered by merging 
the contributions of the neighbours, 



Pi(ipi 



-Hi 



[ Vy> di )e-^^ n «J[p¥\ipi). 



(11) 

We see that the set of equations (0) is self-consistently 

solved by distributions of a bivariate Gaussian type. 

Specifically, for all i = 1, N and all j £ di, the distri- 
ct 

bution P> ' has the form: 



(i) 

where C\ is a 2 x 2 matrix. Insertion into equation 
© yields a set of consistency equations for the matrices 
viz. 



0) 



exp 



4>i 



(12) 



c9 ] = 



F(Cgi\j) + k^2+ i(xa x - yefy) 



(13) 



for all i = 1, N and all j S di and where F is the 
matrix field 

^(4^-)= E {A h l(L a x - A\ t a y )Cf{Ala x - Al^). 

eedi\ 3 

Similarly, equation (|11|) gives the 'true' covariance ma- 
trices 



C 



F ( C di) + k1 2 + i(xcr x - yoy) 



(15) 



for all i = 1, . . . , N. We pause for a moment now to de- 
termine the structure of the matrices {C^ '}. Performing 
the inverse of H in block form reveals enough information 
to allow us to write generally 



C9 ] EE 



(i) -rCO 
a i 

ib9 ] d9 ] 



b) j) e C 



(16) 



If one has a solution set to equations (fT3[) . the 'true' local 
marginals are recovered from equation (| 1 5[) . Recalling 

that the matrices {Q J } and {Ci}, are dependent upon 
z and k, one may employ equation |(7J) to determine the 
spectral density in terms of the function bi = bi(z,z, k), 



Qa{z 



1 N 

,z) = \\m y dzbi{z,z,K). 



nN 



i=l 



(17) 



To deal with the partial derivative appearing in eq. (I17|) . 
we use eq. (|13[) to formulate a similar set of consistency 
relations for the partial derivatives of the covariance ma- 
trices, {chC[ 3) }: 



2 In fact, this factorisation also applies in the fully connected case, 
though the cause is statistical rather than topological. 



CO _ 



-c 





1 



c 



(18) 
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Similarly, the derivative of the 'true' covariance matrix 
at i is given according to (|15[) by 





1 



Ci. 



(19) 



Equations (fT3l fT5l fl8l fT9|) comprise our main result. For 
a given treelike matrix A, one iterates (fT3")) and (jT5J) to- 
gether until convergence. The 'true' marginals are then 
recovered via (fT5|) and fTS")) , and finally the spectral den- 
sity is given by (fT7|) . 

The fully connected limit. - To assess our approach from 
a theoretical viewpoint, we (re)derive the generalised 
Girko's law of [5| in the fully connected limit. To do 
so, we first rewrite A s — > uA s with w 2 = (1 — t)/(1 + r). 

Consider statistically indepdendent matrices A 71 and 
A s , with 



E(4)=0 E(|A£,| 2 ) = (1+t)/2 C) 



(20) 



and similarly for A s . Here, r is a parameter control- 
ling the degree of Hermiticity; at r = 1, A is Hermitian, 
whereas, at r = 0, A is maximally non-Hermitian. We 
will study the limit of large c, by which we understand 
ki — ► c and c — > oo. First notice that equations Q13p 
and p5p . along with the correlations given above, imply 

C± = Ci + C(l/c). Moreover, upon introducing 



c — >oo c — 

2<E3i 



the spectral density takes the following form 



1 



p(z,z) = c\b(z,z). 

7T 



(21) 



(22) 



Then, in the limit c — > oo equation (|15|) yields 



a «6 



1 



a —i(rb + z) 

arf+ |t& + z| 2 V-*( t ^ + ^) d 



,(23) 

where we have set k harmlessly to zero. This equation is 
easily solved giving 



p{z,z) 



fOT (tT7) 2 +(t^) 2 <1 
[ else 



(24) 



This is the well known generalised Girko's law of 

Numerical Results.- For ensembles of sparse random 
matrices, the cavity equations can be solved quickly by 
computer. We present the results, in comparison with 
direct diagonalisation, for two cases: (i) symmetrically 
connected Poissonian random graphs with average con- 
nectivity c and with asymmetric Gaussian edge weights 
with zero mean and variance 1 / c and (ii) asymmetrically 
connected Poissonian graphs with edge weights drawn 
uniformly from the circle of radius 1 / yfc. 

Since numerical diagonalisation of large matrices is 
a computationally demanding task, we have chosen to 




FIG. 1: Spectral density of symmetric Poissonian graphs with 
asymmetric Gaussian edge weights and average connectivity 
c — 5. The red grid is a histogram of the eigenvalues of 10 
samples, the blue lines are the result of the cavity equations, 
averaged over 1000 samples. 



study relatively 'small' matrices of size N = 1000, even 
though the cavity equations are capable of handling ma- 
trices many orders of magnitude larger. In each case, we 
have diagonalised numerically 10 5 such matrices, hav- 
ing an overall of 10 s complex eigenvalues, so as to have 
smooth 2d histrograms. 

For a given matrix, we use the cavity equations as a 
belief propagation algorithm: we iterate (fl~3"|) and (jT5J) to- 
gether until convergence is reached and, then, compute 
the spectral density from (fl"5j) . (fT9j) and (fl"7]) . The results 
are averaged over 1000 samples. 

The results from the cavity equations and comparison 
with numerical diagonalisation are presented in Figs. [T] 
and[2l for cases (i) and (ii), respectively. To give a better 
view of the detail, Fig. [3] shows a pair of slices taken 
from Fig. O Notice that the ensembles in both cases 
satisfy the conditions for Girko's law in the limit c — > oo. 
However, it is evident from the figures that, for finite c, 
they have spectral densities dramatically different both 
from each other and from the limiting case of Girko's 
law. Apart from small discrepances near the boundaries 
due to the discretization the histogram introduces, the 
comparison shows excellent agreement. 

Conclusions.- In this letter we have considered the 
problem of determining the mean spectral density of en- 
sembles of sparse non-Hermitian random matrices. Fol- 
lowing standard steps (o1.ll~5|. the problem can be phrased 
in terms of a Gaussian integral, which we interpret in the 
language of statistical mechanics of disordered systems as 
Within this framework, and following the steps of 
we apply the cavity method, deriving a set of equa- 
tions whose solution characterises the spectral density of 
a given sparse matrix. 

As we have shown, our work puts analytical results 
such as the generalized Girko's law within easy reach, 
when appropriate limits are taken. Moreover, a numeri- 
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FIG. 2: Spectral density of asymmetric Poissonian graphs 
with unitary edge weights and average connectivity c = 2. 
The red grid is a histogram of the eigenvalues of 10 5 samples, 
the blue lines are the result of the cavity equations, averaged 
over 1000 samples. 
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FIG. 3: Cuts along the lines x = 0.3 and x = 0.9 from Fig. [2] 



cal solution for finite-size matrices can be easily obtained 
by belief propagation, giving results in excellent agree- 
ment with those of direct diagonalisation. 

In the case of dense matrices (both Hcrmitian and non- 
Hermitian), past studies using the techniques of super- 
symmetry and replica analysis have found considerable 
success. However, applied to sparse matrices, these ap- 
proaches have not proved as fruitful, leading to a set of 
saddle-point equations which have resisted numerical so- 
lution for over 17 years. 

To make contact with these other approaches, note 
that, in the ensemble average, the cavity and replica 
methods are known to be equivalent. In fact, the so- 
lution we have given here is common to all approaches 
and can also be derived through a careful treatment of 
the aforementioned saddle-point equations [l8l ]. 

For more than 50 years, rigorous analysis of the circu- 
lar law has proven to be rather difficult [j. Therefore, it 
would be a very exciting prospect to reconsider this prob- 
lem by using rigorous techniques introduced in the area 
of spin glasses (e.g. the interpolation method). Work 
along these lines is under way [191 ] . 
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